Remixed Reality: Manipulating Space and Time in Augmented Reality
https://dl.acm.org/doi/epdf/10.1145/3173574.3173703
どんなもの?
live 3d reconstructonを見せるというMixed Realityを使えば、どんなことができるかを提案・整理したペーパー
spatial, temporal, viewpoint changeという三種を提案
先行研究と比べてどこがすごい?
既存のmixed realityは、例えば視点のカメラ映像しか撮ってないならその情報しか使えない
その視点の壁の裏に何があるかわからないから、壁に穴を開けるようなrealityの加工はできない
remixed realityは、時空間の情報を(kinectで取れる範囲)全て記録しているので、いくらでも加工できる
技術や手法のキモはどこ?
技術的な強さはRoomAlive: Magical Experiences Enabled by Scalable, Adaptive Projector-camera Units頼りって感じかな
その上でvoxelごとに分割するみたいな処理はおもろい
どうやって有効だと検証した?
これ、実験とか特にしていなくて、概念の提案だけでCHI通してるのか
すごい
そのくらい厚みのある概念を作りたいblu3mo.icon*3
議論はある?
次に読むべき論文は?
Towards Understanding Diminished Reality、どちらにせよ読む
A Survey of Augmented Reality
関連研究のまとめとしてさしてる
RoomAlive: Magical Experiences Enabled by Scalable, Adaptive Projector-camera Units
技術のベース、kinect, microsoft research
The Dark Side of Perceptual Manipulations in Virtual Reality
おもろい
時間の速度を騙すとかRedirected Walkingみたいな技術の倫理の話?
RealityCheck: Blending Virtual Environments with Situated Physical Reality
GhostAR: A time-space editor for embodied authoring of human-robot collaborative task with augmented reality
おっ
この線でfmrg関連の研究できないかなblu3mo.icon
Seamless, bi-directional transitions along the reality-virtuality continuum: A conceptualization and prototype exploration
Challenges and Design Considerations for Multimodal Asynchronous Collaborationin VR.
Imitative Collaboration: A mirror-neuron inspired mixed reality collaboration method with remote hands and local replicas
空間を歪めたり、時間をループさせたり
Your review should be a couple of paragraphs long and should provide a brief overview of the paper, what it contributes beyond the previous work, what you like about it (explain why), what you don't like about it (explain why), what you think should have been done differently (explain why), and what you think should be done next (explain why).
brief overview of the paper, what it contributes beyond the previous work
live 3d reconstructonを見せるというMixed Realityを使えば、どんなことができるかを提案・整理したペーパー
spatial, temporal, viewpoint changeという三種を提案
既存のmixed realityは、例えば視点のカメラ映像しか撮ってないならその情報しか使えない
その視点の壁の裏に何があるかわからないから、壁に穴を開けるようなrealityの加工はできない
remixed realityは、時空間の情報を(kinectで取れる範囲)全て記録しているので、いくらでも加工できる
what you like about it
新たなrealityの実装手段を提案した上で、そこから生まれる様々な応用を議論していること。
what you don't like about it
not exploring the interaction with real world things deeply. Mostly using the remixed reality as a environment to preceive, and not as a 対象 to interact with. We could further expand the applications by imagining how people could talk with other people, grab and move things, make changes in remixed reality.
what you think should have been done differently
although it has enough contribution as a paper suggesting a new technology, it would be more interesting with user studies (both quantitative and qualitative) under specific use cases. How would user interact with objects or people in the remixed reality? How would human understand the gap between his/her body viewpoint and the virtual viewpoint (spatially and temporally) ?
what you think should be done next
Further exploring spatiotemporal modification techniques, and how it could change the way human communicate with other people would be interesting. Having a room with looped time, each people having a subjective speed of time, etc.
Using data other than depth and camera sensors to create a multimodal recording would also be interesting. Predicting a tactile sensation or smells from images and reconstructing it in remixed reality, etc.